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A METHOD AND DECODING APPARATUS USING LINEAR CODE WIIH 
PARITY CHECK MATRICES COMPOSED FROM CmCULANTS 

CROSS-REPBR HNCE TO RBT-AUD APPLICATION 
This appKcaticm claims priority from U.S, Provisional AppUcation 
60/352,612 filed on January 29, 2002 for inventors Alexander V. Kuznetsov, Bane 
Vasic and Erozan Kurtas and entitled A METHOD AND DECODING 
APPARATUS USING LINEAR CODES WITH PARITY CHECK MATRICES 

COMPOSED FROM CIRCULANTS, which is herein incorporated by reference. 

FIELD OF THE INVENTTON 

The invention relates generally to data storage and/or communication 

systems. More particularly, the invention relates to the iterative soft and hard 

decoding of linear codes defined by flie parity check matrices composed from 

submatrices with a cyclic property (circulants). 

BACKGROUND O T? THE INVENTrnM 
Recently, various types of turbo codes have been proposed for 
communication channels and storage systems. Combined with a BQR (BaW, 
Cocke, Jelinek and Raviv) algorithm or a Soft-Output Viterbi Algorithm (SOVA) 
those codes provide flexible tradeoffis in complexity and Bit Error Rate (BER). 
But due to the high latency of the decoding process, turbo codes are 
inappropriate for extremely high speed communication and high-derjsity 
magnetic recording applications. 

Similar BER characteristics at the lower level of complexily can be also 
achieved by the use of the Gallager Low Density Parity Check (LDPC) codes 
defined by a parity check matrix with some small fixed number of ones in each 
column. Originally, the LDPC codes have been constructed by random choice of 
the parity check matrix, but such codes require very complex encoders and 
decoders in general. Despite tremendous pmgKSS in achieving BER 
characteristics using LDPC codes, the problems of implementation complexity 
were left aside until the current time. A significant insist into the nature of 
iterative decoding has been gained due to interpretation of the decoding 
algorithms in terms of belief propagation in graphical models, but tiiese 
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graphical models of message passing are tased miainly for ihe illustrative 
purposes, and the complexity factors still dominate system architecture and 
design considerations, especially in extremely high speed applications such as 
magnetic recording* The high complexity of the existing schemes is a direct 

5 consequence of Ae fact that parity check matrices of the random LDPC codes do 
not have a regular structure, and therefore large amounts of memory and logic 
gates are reqiiired to build corresponding encoders and decoders. 

The results of several studies of LDPC based communication and storage 
systems have been recently reported and several schemes based on random 

10 regular and irregular LDPC codes have been described. The irregular LDPCs 
have parity check matrices with multiple colirnm weights and linearly 
dependant rows (defidmt rank parity check matrix). These codes enable faster 
encoding since the dimension of the systematic form of the parity check matrix 
used to calculate parity bits turns out to be much smaller than the ntmiber of 

15 parity check equations used in decoding. However, the parity check matrix of 
an irregular code is still similar to the random structure of a Gallager LDPC. 
Another approach is the algebraic construction of LDPC codes using finite 
geometries. The finite geometry LDPC codes are quasi-cyclic and their eiKoders 
can be implemented using linear shift registers wiiii feedback connections 

20 defined by the generator polynomial of the code. The resulting codes have been 
demonstrated to have excellent performance in AWGN, althoug^i their rates are 
still low for high data rate applications, and decoder complexities are somewhat 
high. 

A class of structured high rate LDPC codes with orthogonal parities has 
25 been constructed from Kirkman triple systems. Both finite geometries and 
Kirkman systems are special classes of the Balanced Incomplete Block Designs 
(BIBD). Although many different types of ttie BIBD are described in the 
mathematfcal literature, not many of them give LDPC codes with high rates and 
sufficiently large minimum Hamming distances. 
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Therefore, the complexity issues remain to be the dominant factor that 

prevent the wide use of the LDPC based architectures, especially in extremely 

high speed applications such as magnetic recording. The high complexity of the 

existing schemes is a direct consequence of the fact that parity check matrices of 

the random LDPC codes do not have a regular structure, and therefore large 

amounts of memory and logic gates are required to build corresponding 

encoders and decoders. A proposed method of overcoming the problems of 

implementation complexity would be a significant improvement in ttie art. 

SUMMARY OF TEIE INVENTTON 
The present invention provides a novel mefliod and apparatus for 

decoding digital informatian transmitted through the communication channel or 

recorded on a recording medium. In some embodiments of flie invention, the 

method and apparatus are applied in tfie systems where data is encoded uahg 

structured LDPC codes with parity check matrices composed from drculants (a 

15 matrix is called a drculant if all its ojlumns or rows are cycEc shifts of each 
other). A class of such codes is constructed from integer lattices, and described 
later. A more complete understanding of tiie present invention, as well as other 
features and advantages of the present invention, may be obtained with 
reference to the following detailed desaiption and accompanying drawings. 

20 Other features and benefits that characterize embodiments of tiie present 

invention will be apparent upon reading the following detailed description and 

review of the associated drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a plan view of a disc drive in accordance with embodiments of 

25 the present inventioiu 

HG. 2 is a block diagram illustrating a read channel architecture in which 
the embodiments of the LDPC decoder of the present invention can be 
implemented. 

PIG. 3 is a bipartite graph of one low density parity check (LDPC) code. 
30 FIG. 4 is a block diagram illustrating first embodiments of the LDPC 

decoder shown in HQ. 2. 
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FIGS. 5, 6-1, 6-2, 7 and 8 are block diagrams illusttating in greater detail 
portions of the LDPC decoder shown in HG. 4, in accordance with various 
alternate embodiments. 

PIG. 9 is a block diagram illustrating second embodiments of <he LDPC 

decoder shown in HG. 2. 

FIGS. Id, 11 and 12 are block diagrams illustrating in greater detail 
portions of the LDPC decoder shown in HG. 9, in accordance with various 
alternate embodiments. 

HG. 13 is an example of a rectangular integer lattice used to illustrate 
features of LDPC matrices with which the decoders of the present invention can 
beused. 

nFTATT .KD DBSCRIPTrQN OP ILLUS TRATIVE EMBODIMENTS 
The present invention discloses a new eftident decoding technique for tine 
LDPC codes constructed mainly from the BIBD's. A new wide dass of such 
LDPC codes is described in tiiis application using tiie notion of an integer lattice. 
As seen below, these codes have very well strurtured parity check matrices that 
are suitable for tiie efficient implementation of encoding and decoding circuits. 

FIG. 1 is a plan view of a disc drive 100 which indudes a housing witii a 
base 102 and a top cover 104 (sections of top cover 104 are removed for darity). 
Disc drive 100 further indudes a disc pack 106, which is mounted on a spindle 
motor (not shown). Disc pack 106 indudes a plurality of individual discs 107, 
which are mounted for co-rotation about central axis 108. Eadi disc 107 has an 
assodated product head 112 which carries one or more read and write 
transducers (read and write heads) for communicating witii disc surface 109. 
Each product head 112 is supported by a suspension 118 whidi is in turn 
attached to a track accessing arm 120 of an actuator assembly 122. Actuator 
assembly 122 is rotated about a shaft 126 by a voice coil motor 124, which is 
controlled by servo control circuitry, to move head 112 in an arcuate pafli 130 
between a disc inner diameter 132 and a disc outer diameter 134. 
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Also shown in FIG. 1 is circuitry 128 which diagrammatically represents 
circuitry associated with the channel architecture used in processing signals to 
be written to or read from the disc or media surface. Ihe position in which 
circuitry 128 is located need not be as shown in FIG. 1, but instead, the position 
of drcuitty 128 shown in HG. 1 is provided as an example for discussion 
purposes. Furtfier, disc drive 100 is intended to represent any of a variety of 
data storage devices in which the methods and apparatus of the present 
invention can be implemented. In other embodiments, disc drive 100 can be 
other types of magnetic disc drive, or can be other types of disc drive such as an 
optical disc drive, a magneto-optical disc drive, etc. The methods and apparatus 
disclosed herein can also be used in otiier data storage devices, for example in 
magnetic tape storage devices. Furttier still, the methods and apparatus of the 
present invention can be used in environments other than data storage systems. 
For instance, tihie methods and apparatus of the present invention can also be 
used in communication systems. The following discussion, though directed 
specifically to data storage systems at times, is intended to be applicable to all 
such uses of the present invention, and disc drive 100 is intended to represent 
but one type of communication system in which the present invention can be 
practiced. 

FIG. 2 is a block diagram illustrating dioiitry 128 used to implement the 
channel architecture in some embodiments of the invention in which a data head 
interacts witti a recording media, for example in disc drives or other data storage 
systems. Although shown in FIG. 2 in tiie context of a data storage system, the 
low density parity check code generating systems and methods of the present 
invention are not limited to use in data storage apparatus, but instead can be 
used in other environments such as in commimications systems. 

As shown in HG. 2, the channel architecture can indude a number of 
difiierent encoding/decoding circuits, each encoding or decoding data in 
different manners for different purposes. The various circuits shown in the 
blocks of FIG. 2 can be implemented as integrated circuits, disaete components. 
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or suitably programmed processing circuitry. For discussion purposes, various 
blocks shown in HG. 2 are referred to generically as being circuitry. 

As shown in HG. 2, data bits of a message word to be recorded on the 
recording media 109 are provided to cyclic redundancy check (CRC) encoder 
circuit 202 and then to E5 error correcting code (ECC) circuit 204. CycUc 
redundancy check encoder circuit 202 encodes the data using coding techniques 
of the type w*ich are well known in tiie art in order to minimize mis-correction 
of errors in the decoding process. Error correctfaig code circuit 204 introduces 
additional bits to the message data bits. The additional bits improve the ability 
10 of the system to recover the signal when the encoded signal has been corrupted 
by noise introduced by the recording channel. The order of CRC encoder circuit 
202 and ECC encoder circuit 204 is not limited to the specific arrangement 
illustrated in WG. 2. Also, circuitry 128 shown in HG. 2 inchides a RS ECC 
decoder circuit 218 and a CRC checker circuit 220 in order to decode and CRC 
15 check data read back from the media using heads 112. 

Witiun tiie inner sub-channel are run length limited (RLL) encoder 206 
and decoder 216, which are of the type weU known in the art. Run length 
limited encoder i206 can, in other enibodiments, be implemented before RS ECC 
encoder if deared. Similar repositioning of RLL decoder 216 would also occur in 
20 these o*er embodiments. Low density parity check encoder circuitry 208 
encodes the data wifli LDPC codes having particular characteristics, which are 
discussed below in greater detail. 

Precoder circuit 210 is optionally included in the inner sub-chaimel and 
can be used to implement a code of rate 1/1. Generally, precoder circuit 210 is 
25 used to eliminate catastrophic error events and/or to convert the data fi»m 
binary to another format Front-end and timing circuit 212 filters and converts 
an analog read back signal from the head into a digital signal, providing timing 
for sampling of the read back signal Channel detector 214 and UDFC decoder 
215 function together as desaibed below to convert the digital signal into a 
30 binary (Le., I's and O's) signal While read/write channels of magnetic and/or 
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optical disk drives are primiary targets of the present invention/ the present 

invention relates mainly to LDPC decider 215. 

t Structure of Ihe parity check matrices used in 0ie invention 

A cdrculant is a matrix whose cohimn (rows) are cyclic shifts of its fiist 
column (row). In this invention, we consider commimication or storage systems 
where data lare encoded using linear codes with the parity check matrices in the 
form described in Equation (1): 



(1) 



where all sub-matrices Hij,l^i^a,l^ j^t are mxm drculants. In the 
Appendix at the end of this disclosure, we describe a wide dass of LDPC codes 
with such parity check matrices constructed from drculants with the column 
weight 6 = 1, The following notations for code parameters are used below: 

a isthe number of circulants, ff,-,^-, in one column of Equation (1); 

t is the ntmiber of drculants, in one row of equation (1); 

m is the number of rows and columns in one circulants i?/ J ; 

& is the niunber of ones in one column (row) of the circulants, Hi j ; 

* = a-6 is the column weight of a parity check matrix ff ; 

M = m'a isthetotalnumberofttie parity checks; and 

N = m't is the length of the code. 
For illustrative purposes we will use the following parity check matrix of the 
lattice LDPC code of lengtiti N=:25 with 10 information bits and 15 parity bits 
(a=3,b=l,t=m:^): 
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(2) 



Another wide class of efficient LDPC codes can be constructed using Kirkman 
and Steiner systems. For these codes a=l, and the parity check matrix of 
5 Equation (1) has only one strip of drculants. An example of such a parity check 
matrix used later for illustrative purposes is given below in Equation (3). 
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In this example, a = l,fc=3 and therefore the column weigjit of H is equal 
jk = d>=3. This parity check matrix is constructed from the (26^1) Kirkman 
system. 

ti general, other types of the BIBD can also give parity check matrices of 
the form shown in Equatton (1) with different values of the parameters a, h t 
and m. The fad that submatrices H^, in Equation (1) have a circular properly 
can significantly simplify tiie hardware implementation of the encoder and 
decoder circuits. 
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2. Description of the decoding memod 

As described above,. HG. 2 is a block diagram iUustrating di^t steps 
of encoding and decoding of data in a disc drive or other data storage system 
»ising LDPC codes. Although in HG. 2 the LDPC encoder and decoder are 
considered in the context of a data storage system, the present invention is not 
limited to be used in data storage, but also can be used in other environments, in 
particular, in communications systems. As shown in HG. 2, the complete 
channel architecture can include different encoding/decoding circuits used for 

different purposes and sometimes performed in different order. For example, the 
RLL encoder can be located before the RS encoder (reverse RLL-ECC scheme). 
The precoder is optional, and used to eliminate catastrophic error events and/or 
to convert the data from NRZ (Non-Retum-to-Zero) to NRZI (Non-Retum^o- 
Zero Inverse) formats or vise versa. JRront-end and timing circuits convert an 
analog read back signal from the head into a digital signal processed by 
detection scheme. 

Outer decoding iteration. In HG. 2 the detection scheme consists of a 
cascade of a channel detector 214 and an LDPC decoder 215. The channel 
detector can use Soft Output Viterbi Algorithm (SOVA), Bahl-Cocke-Jelinek- 

Ravhr (BgR) algorithm, or other types of algorithms that can provide so called 
log-likelihood ratios A(0=log(;,,/a-p,)), where is the probaWKty that the 

transmitted bit of the code word is equal to 1 (l^i^ AO. These log-likelihood 
ratios m are used by the LDPC decoder 215 as inputs to get "improved" soft 
decisions regarding transmitted data. 

An input of the LDPC decoder 215 is a vector of real numbers 
A = (Aa), A(2),...,A(iV)) generated by the channel detector 214, and the output is 

the vector of corrected log-likelihood ratios A'= (A(1)',A(2)' A(AO'). This 

process is often called updating log-likelihood ratios, and involves the 
calculationof a vectorof "coirectians'' |*0).M2).....M(A0. When the corrections 
M are calculated, the "old" values A(i) are replaced by the updated "new" 
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values X{j)+fiij)) . We refer to ttie combined operation of a channel detector 
and the LDPC decoder as an outer iteration. As we already mentioned before, 
the log-likelihood ratios updated by the LDPC decoder can be sent back to the 
channel detector, and this will start tihe second outer iteration. This iterative 

5 process can be stopped after a predefined number of outer iteration, or 
according to some other rule. 

Inner decodii^ iteration. Usually, using an input A(1),A,(2) M.N)> the 

LDPC decoder 215 calculates the corrections ^(l),/i(2),..../i(JV) in an iterative 
manner as well. Although these inputs and outputs are vectors, internally the 

10 LDPC decoder operates with stacks of inputs AO*)=:{A(iJ).l^'<*). a^^d 
outputs /iU) = {M».J).l^»<*}. for each code bit Uj,l^j<N. In this 
application the Message Passing Algorithm (MPA) described below is 
considered as a basis for the implemenUtion of the LDPC decoder 215. The 
operation of the LDPC decoder can be explained via a bipartite graph. An 

15 example of the bipartite graph for the parity check matrix given by Equation (2) 
is shown in HG. 3. "Hds graph has two kinds of vertices: 25 bit nodes (labeled 
250) and 15 check nodes (labeled 255). An edge between a bit node and check 
node exists if the bit is included in the given check. The following two kinds of 
index sets are used in the MPA: 

20 The j-th column index set B{j) consists of the ntunbers of all parity 

checks that contain the ; - ift code bit, and formally is defined by Equation (4). 
Bij) = {i:h,,j=U^i^M] (4) 
where Ajj is an element of i-th row and j-th column of the parity check 
matrix fl. For example, J?a) = a6Jll}/ 5(2) ={2.742},..., 5(25) = {5.9^3} for the 

25 parity check matrix H defined by Equatfon (2), and 5a) = {lA5}/ 
5(2) = {2,3,6}...., 5(26) = {2,7.13} for the parity check matrix H defined by 
Equation (3). The letter "B" points here on bits. 

The i-th row index set C(Oof H consists of positions of the code bits 
involved in the i-th parity check equatton, and formally defined by Equation 5. 
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C(ii)={j:\j =1,1^ j^N) (5) 
where hi j is again an element of row and j-A colunm of the parity 
check matrix H, For example, C(l) = {1,6^146,21}, C(2) = {2,7,1247,22} , 
C(X5) = {5.8,1149,22} for the parity check matrix H defined by Equation (2), and 
5 Ca)= {14044.20,25}, C(2) = {1,24145,21,26},..., CQS) = {9424349,24,26} for the 
parity check matrix H defined by Equation (3). The letter "C" points here on 
checks. 

The actual operations performed by tiie MPA and illustrated by tiie 
bipartite graph shown in HG. 3 are described below. FIG. 4 shows the block 
10 diagram of a first embodiment 215-1 of the LDPC decoder 215 that ccmsists of N 
units A (labeled 310-1 tiirough 310-N) , a tmit B 320, N units C (labeled 330-1 
through 330-N), and N units U (labeled 308-1 through 308-N). 

Unit A. As it is shown in HQ. 4, each input X(},j),lSi^k,l^j^N, is 

passed through one of tiie units A 310-3, and converted to tiie real number 
15 defined in Equation (6). 

These output values of units A are sent to the inputs of the corresponding units 
C 330 and to tfie unit B 320. 

Unit B* The function of this unit 320 is ttie calculation of the following 
20 products (one for each row of the matrix H ): 

X(i)^UjeCmMiJX 0£i<M, (7) 

where C(0 is defined by Equation (5). Di^rent simple implementations of the 
25 block B circuit 320 are considered later. 

Unite Each value ^L(Uj)^<i<Kl^ j^N is calculated in a unit C 330 
using an output A(i, ;) of the input stack and the output X(i) of the vinit B 320 
as follows: 
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5 This sequence of calculations can be illtistrated using bipartite graphs. With the 
each bit node we associate k values A(/, j) and A(i,7) enumerated by the first 
index l<i^k (the second index 1^ j^N refers to the bit itself). Then for all 
check notes using unit B we calculate ihe values X(i) = TijeC(i)^^^*J^' 1 ^ i ^ M, 
where tiie set C{i) can be interpreted as a set of incoming edges of the 

10 i-^ft check node- When all check nodes are assigned the values Xii), we go 
back to bit notes and calculate ihe values 1 < i ^ 1 ^ J ^ ^- / as it was just 
described using Equations (8) and (9). Finally, using the column index sets B(j) 
for the next internal iteration, we update Ihe input values j) using unit U 
circuits 308 according to the following rule- 

15 Unit U. The new j-Oi input stack is calculated using Equation (10): 

A0'.7)-Aa)+ S/x(i,;), (10) 

where the set Bij)\i is the set ^O) witiiout dte element i, and 

Controller. In an implementation of unit B 320 shown in FIG. 5, a 
function of the controller 385 is the synchrortization of all operations in time 
domain. In partkrular, the controller dianges positions of ihe top row of switches 
in FIG. 5 after each block of m inputs is fed to the unit E. This operation is 
25 performed t times during one inner iteration, and each time the next control 

vector bi -Q\ifb2j b^j) is read from ROM and sets positions of switches. 

Here, the l-th control vector 6| is tiie transposed first column of the l-th 



(8) 
(9) 



in 
ic 
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ciiculant of H with elements "1" replaced by their numbers in this ooW For 
example, the first control vector b, » (1.0.0.0.0.2.0.0,0.0^0.0.0.0) conesponds to 
the first transposed column (1.0.0.0.0.. 1,0.0.0.04.0.0.0.0) of equation (2). When aU 
inputs are fed to the input B, the controiler doses all switdtes in the bottom 

' of FIG. 5, and make the contents J:(0 of the shift register available to the 

units C. 

Th^ Equations (4H10) describe the operation of a generic MPA decoder, 
and, do not use the spedfic structure of the parity diedc matrix shown / 
Equation (1). Below we describe the novel method of implementing the spedfi. 
units, and this implementation essentially use the fact that H is constructed 
from drculants. 

Implementations of the unit a For the LDPC codes with the parity diedc 
matrixconsistinglromonestripofrdrculantsofthesizemxm (a=l) the unit B 
(drcuit 320) can be constructed in a number of ways to provide different 
tradeoffe in speed (calculation time) and hardware complexity (mmd,er of 
gates). Awidedass of codes with thedrcularproperly can beconstructedfiom 
Kirkman systems. An example of sudi a parity dieck matrix ^ is given by 
Equation(3),where« = l3and* = 2. In this example, the parity diedc matrix 
consists of two drculants of the size 13x13. 

First, let us consider so called "fuU serial implementation" (referenced in 
HG. 5 as 320-1) of Ae unit B whidi uses only one shift register 350 of length m 
with feedbadc We also call this shift register as unit E. It consists of m dday 
elements 360 shown as boxes, and is capable of storing teal numbers with some 
predefined level of accuracy. Between the delay elements 360 are muIt^Hcation 
elements 370 with two inputs and one output An output of eadv multiplication 
element 370 is a product of real numbers at its inputs. Eadi multiplication 
element 370 is oornieded to the adjacent delay elements 360 and the input bus 
372 through the corresponding switdi 375 (there are M switdies 375) controUed 
by the vector 380 (6i,/.A2,/,....f>^/) stored in read only memory (ROM) 382 and 
described before in the controller section. Eadi sudi vedor coinddes with the 
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first colunva of one of the drculants. All delay elements 360 are initially reset to 1 
(store the real number 1.0). The imit E operates as follows. 

The inputs of the block E :A(1).A(2) AiN), are fed through the input 

bus 372 sequentially. During ttiese N time intervals, the positions of switches 

5 375 are changed only t times: when after the first m inputs 
A0),A(2),...,A(m)arefed, when tiie second minputs A(m+l),A(m+2),...,A(2OT) 
are fed, and so on. Initially, all switches 375 are set according to the first control 

vector (i>i4,*2,i b^), as follows. If =0, the top input of the multiplier is 

set to 1.0, otherwise it is connected to the bfj -th input line, and became equal 

10 to KQji^i , j) • After feeding the first ii^ut block Aj, but before feeding the second 
block A,, the switches 375 are set according to the second control vector 
(K2»h,2»""^m.2>' and so on. AU * control vectors are stored in ROM 382!, or 
generated by logic circuits. The controller 385 shown in FIG. 5 does tfie 
synchronization of all these operations. 

15 When all N values A(1),A(2),.. ., A(AO are entered, the delay elements 360 

of the shift register will contain the products X(1).X(2) X(M) defined by 

Equation (5). The following example illustrates this process, how the last 
statement can be verified in tiie general case. 
Exowpfe 1. Let a = t f = 2, M = m « 4, = on = 8 and 



20 H = 



10 0 1110 0 

I 1 0 0 0 1 1 0 

0 1 1 0 0 0 1 1 

0 0 1 1 1 0 0 1 



For simplicity, let us denote the inputs 

al = Aa4), M = A(U) , cl = AftS) , 41 = A(2,4) , 
a2 = A(24) / b2 = A(2^) , c2 = A(23), 42 = A(1.4) , 
el = A(U) , fl = ACW), gl = A(2,7) , M = A(2^) 
25 e2 = A(2^), /2 = Aa^), «2 = Aa.7). h2=A(lfi). 
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Therefore, in this case the unit B 320-1 must finally produce the following four 
products specified in Equations (7), and contains a corresponding number of 
switches 375 and delay elements 360. 

Xa)=A(l.l)Aa,4).Aa4)Aa.6) = alrf2cl-/2, 

X(2) = A(24)- Aa2) • A(2.6) • A(l,7) = a2-bl-flg2, 

^(3) = A(2,2) . Aa3) • A(2,7) • A(l,8) = 62 • cl . • A2 , 

X(4) = A(23) • A(2,4)- A(2^ . A(2.8) = cldlelKl.. 
HG. 6-1 illustrates a portion of unit B 320-1, and shows positions of the switches 
375 during the first four time intervals when the first four pairs of inputs 
(al,a2),(i>l,&2),(cl,c2) and (</l,d2)are fed to tiie scheme. As we described 
before, the positions of the switdtes are defined by the first control vector 
[1,2,0,0] . Using this figure, we can easily track the contents of the delay elements 
360 while the pairs {ala2),{blb2),(cU2) and (4l,d2) are received: 



Initial state: 


1 


1 


1 


1 


After feeding a: 


a2 


1 


1 


al 


After feeding b: 


b2 


1 


al 


a2bl 


After feeding c 


c2 


al 


a2bl 


b2cl 


After feeding d: 


ald2 


a2bl 


b2cl 


c2dl. 



Before feeding in the next four input pairs (el,e2). (/l,/2), (gl,g2) and 
QA,h2), the positions of the switches 375 are changed according to tiie second 
control vector [1002], as shown in FIG. 6-2. Using Hob setting, we can trade tiie 
next four states of the delay elements 360: 

After feeding e: a2bl b2cl c2dl€2 ald2el 

After feeding b: b2cl c2dle2 ald2elf2 a2blfl 

After feeding c: c2dle2 ald2elf2 a2blflg2 b2clgl 

After feeding d: ald2el£2 a2blflg2 b2clglh2 c2dle2hl. 

After the comparison of the last line and E(]uations (8), we see after feeding in all 

eight inputs the delay elements 360 contain the desired products X(J) . 
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HG. 7 and 8 show other implementations of the unit B circuit 320 which 
are faster then the scheme (320-1) shown in HG. 4, but require more delay 
elements. These implementations are referred to herein as "serial-paraUel" and 
"full parallel" respectively, and use t different shift registers 350 (one for each 

5 base block of H ). In this case, there is no need for switches in the feedback and 
many of the multipliers, since the coefficients bjjin each shift register are Bxed. 
The input sequence of A(0 is split onto t subsequences 
Aiiii),0^h<U corresponding to t drculantsof H: 
Ai(7) = (Aa),A(2) Aim), 

10 A2(;") = (A(m+l),A(m+2),...,A(2*m), 
A3(j) = (A(2m+l),A(2m+2),...,A(3TO),.... 

These subsequences are entered into the shift registers 350 in paraUel When it is 
done, each unit E will have a vector of partial products corresponding to . 
different drculants of H . Then by multiplying the real numbers contained in the 

15 delay elements #1 in different units E (i.e., similarly positioned delay elements 
from each of the different units E, in this case ti\e left most delay element in each 
unit E as shown in PIG. 5), we get X(l). In same way, by multiplying the real 
numbers contained in the delay elements #2 gives X(2), and so oa This can be 
done sequentially using just one mult^lier 390 with / ii^uts. Such 

20 implementation is called serial-parallel, and illustrated in HG. 7 unit B circuit 
320-2. If m multipliers 395 are used in parallel, the implementation is called full 
parallel, and is illustrated in FIG. 8 as unit B circuit 320-3. 

It is also possible to implement an LDPC decoder without the 
multiplication elemaits, and can be done using the following Equations: 

25 V(i,;) = logA(i,;-) = logtaiih(-^^), (H) 

W(0=logX(i)= IViUJ), (12) 
yO-.i)=exp(W(i)-V(j)), (13) 
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Using Equations (11), (12) and (13) instead of Equations (4), (5) and (7), 
respectively, multipUcation elements 370 can be replaced with addition 
(summation) elements 470 (HG. 10). These two sets of Equatioiis are e«jaivalent, 
but lead to different implementations. In a second embodiment 215-2 of LDPC 
encoder 215, which is shown in HG. 9, ttie new units A' (410), B' (420), C'(430) 
and E' (450 shown in HG. 10) are used instead of units A (310), B (320), C (330) 
and E (350), respectively. Their functions and descriptions are similar to what we 
akeady provided above with reference to HGS. 4-8. Using the corresponding 
operations, the circuits shown in HGS. 9 through HG. 12 can be used instead of 
FIGS. 4r8. For ease of understanding how the above analysis of HGS. 4-8 apphes 
to the embodiments shown n HGS. 9-12, the deso^on of numbers in the 300's 
in HGS. 4r« corresponds to numbers in the 400's in HGS. 9-12 (delay elements 
360 correspond to delay elements 460, etc), except that addition elements are 
used instead of multipHcation elements (i.e., elements 470 instead of 370 in HG. 
10, element 490 instead of 390 in HG. 11, and elements 495 instead of 395 in HG. 
11). 

In summary, the present invention includes a communication system 100, 
which can be for example a data storage system, for decoding data which is 
encoded with a linear low density parity check code having a parity check 
matrix H constructed from drculants. The communication system includes a 
channel detector (214) which provides as an output log-likelihood ratios, each 
log-likdihood ratio being indicative of a probabiHty that a transmitted bit m of a 
code word is equal to 1. The communication system also including a low 
density parity check code decoder (215) coupled to the channel detector and 
receiving the log-likelihood ratios A as an input, the decoder configured to 
convert the log-likeffliood ratios into real numbers A, to generate corrections 
/I to the log-likelihood ratios A, and to generate corrected log-likelihood ratios 
A' as a function of the log-likdihood ratios A and the corrections /i , tiie decoder 
providing as an output a binary signal 
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Ih some embodiments, tiKe decoder (215; 215-1) furttier includes 
conversion circuitry (310) which receives a stack of i log-likelihood ratios 
A(i, j)£or the j*^ bit Uj of the code word and converts the stack of log-likelihood 

ratios into a stack A{i,j) of real nimibers. The conversion circuitry also includes 
5 product calculation circuitry (320) OTupled to the conversion circuitry (310) 
which generates for each row of the parity check matrix H a product X(i) from 
the real numbers, where X(i) is substantially of the form 
^^^) = Ilj^c{i)^^^'i^' 0^i<M, where C(/) is substantially of the form 
C{i)-{j:hii =l,l<j^N}, and where hij is an element of i-th row and j-th 

10 column of the parity check matrix H. Correction generating circuitry (330) 
coupled to the conversion circuitry (310) and the product calculation circuitry 
(320) generates ttie corrections fi by generating each corzection value ^L{h j) of a 
stack of correction values using corresponding values from the stack A(iJ)ot 
real niunbers and using the corresponding product X(i) from the real numbers 

15 using a relationship substantially of tiie form /x(i,/) = log | y^!'*!? / where 

' y(j,;)issubstantiallyoftiieformy(i.;) = X(i)/A(/,j')- 

In some embodiments, the decoder further comprises log likelihood rati^ 
stack generating drcuitry (308) coupled to the conversion circuitry (310) and to 
the correction generating circuitry (330), the log likelihood ratio stack generating 
20 circuitry (308) calculating a new input stack X{U j) using a relationship 

substantially of the form A(i. ;) = XiJ) + S/^(i» j)f where the j* set B(j) 

ieBU)\i 

includes the numbers of all parity checks of the low density parity check code 
that contain the code bit, and wherein set BU) \ i is the j**^ set BU) without the 
element!, and wherein l^i^^^l^;:^//. 
25 bi some embodiments of the communication system, the product 

calculation circuitry (320; 320-1) further includes an input bus (372) carrying the 
stack A(i\ j) of real ntunbers, and a memoiy device (382) storing multiple control 
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vectors, with each of the control vectors corresponding to first column of one of 
the drculant sub-matrices of the parity check matrix H. In these embodiments, 
the product calculation circuitry further includes a lirsl set of m switches (375) 
coupled to the memory device and being controlled by one of the control vectors 
at a time, each of the first set of switches having inputs coupled to the input bus 
and having an output The product calculation drcuitiy further includes a shift 
register (350) including m delay elements (360) and m multiplication elements 
(370), a first input of each multiplication element being coupled to an output of a 
first corresponding delay element, a second input of each multiplication element 
being coupled to the output of a corresponding one of the first set of switches 
(375), an output of each multiplication element being coupled to an input of a 
second corresponding delay element, wherein the product X(0 from the real 
numbers is provided by the delay elements. In some embodiments of the 
invention, the product calculation circuitry (320; 320-1) further comprises a 
controller coupled to the memory device and controlling which of the control 
vectors is used to control the first set of m switches. 

In other embodiments of the communications system of the present 
invention, the product calculation drcuitiy (320; 320-2) furflier includes a 
pluraUty of parallel shift registers (350), wherdn each of the pluraUty of shift 
registers has fixed feedback connections , and wherein an input sequence of A(0 
is split onto / subsequences A/,(i). 0<,h<t, corresponding to t drculants of H, 
each of the subsequences being entered into a different one of the plurality of 
shift registers 350 in paraUel, each of the shift registers providing as an output a 
vector of partial products corresponding to different drculant sub-matrices of 
the parity check matrix H. The product calculation drcuitiy fiirlher indudes a 
multiplication element (390) receiving as inputs the vectors of partial products 
from eadi of Ihe plurality of parallel shift registers and sequentially providing as 
an output the products X(/) . 

In still other embodiments of the present invention, the prtxiuct 
calculation circuitry (320; 32^3) further comprises a plurality of parallel shift 
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registers (350), wherein each of the plurality of shift registers has fixed feedback 
connections, , and wherein an input sequence of A(0 is split onto t 
subsequences A/j(0,0^ A<r, corresponding to t drculants of H, each of the 
subsequences being entered into a different one of the plurality of shift registers 

5 350 in parallel, each of the shift registers providing as an output a vector of 
partial products corresponding to different drctdant sub-matrices of the parity 
check matrix H. In these embodiments, the product calculation circuitry (320; 
320-3) further comprises a plurality of multiplication elements (395) each 
receiving as inputs the vectors of partial products from each of the plurality of 

10 parallel shift registers and providing as an oulput a corresponding one of the 
products X(0 . 

In some embodiments of the communication system of the invention, 
decoder (215; 215-2) further comprises conversion circuitry (410) which receives 
a stack of i log-likelihood ratios X{hj)ioT the bit a^of the code word and 

15 converts the stack of log-likelihood ratios into a stack j) of real numbers. In 
these embodiments, the decoder also includes summation calculation circuitry 
(420) coupled to the conversion circuitry (410) which generates for each row of 
the parity check matrix H a summation W(i) from the stack V(iJ)oi real 
numbers, wherein Vf(i) is determinable using a relationship substantially of the 

20 form W(0 = Y,^{Uj) , and correction generating circuitry (430) coupled to the 

conversion circuitry (410) and the sxmunation calculation circuitry (420) which 
generates the corrections by generating each correction value ^(i, j) of a stack 
of oorrecticm values. Each correction value of a stack of correction values 
is generated using corresponding summations W{i) and real ntimbers according 

25 to a relationship substantially of the form ;) = log^^^^^ / where Y(i, j) is 

1+ 2 y t J) 

substantiaUy of the form Y(i,;) = exp( W(i )- V(;) ) . 

A mefliod of decoding data, which is encoded with a linear low density 
parity check code having a parity check matrix H constructed from drculantS/ 
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indudes generating log-likelihood ratios with a channel detector (214), each log- 
likelihood ratio being indicative of a piobabiUty that a traiwmitted bit « of a code 
word is equal to 1. Ute log-likelihood ratios A are converted into teal numbers 
using a low density parity check code decoder (215). Also using the decoder/ 
corrections fi to the log-likelihood ratios X are generated. Further, the decoder' 
generates corrected log-likelihood ratios A' as a function of the log-likelihood 
ratios A and the corrections and provides a binary signal as an output. 

It must be understood that the Equations defined herein can be 
implemented as approximations or scaled versions of the complete Equations. 
Hierefore, references to specific Equations, to relationships substantially of the 
form defined by one or more Equations, and other references to Equations 
should be interpreted as including approximations of the Equations, scaled 
versions of the Equations (on one or both sides of the Equations), and other . 
derivations of the Equations. These interpretations also apply to the claims 
appended hereto. 

This clarification is related to the fact that the mathematical cafculations 
defined by the equations (6H13) are usually done by the physical devices with 
limited precision of an internal nahire or be set to some specific level artificially 

to minimize implementation complexity or satisfy other technical constr^^^ 
For example, the representation of the real numbers has usuaUy finite length 
measured in bits per real number. Approximation of the functions, such as 
"tanh", -log" and "exp" and others, is also a standard technical solution which do 
not changes the basic principles of the decoding metiiod. For example, dipping 
of the very large or very smaH values is often used to limit the range of analog 
values. Look-up tables can also be used to replace analog calculations in the 
digital implementation of the proposed decoder. 
Appendix. Lattice construction ofOie IDPC codes. 

In general, in combinatorics a design is a pair (V,B), where F is a set of 
some elements called points, and S is a collection of subsets of V called blodcs. 
The numbers of points and blodcs are denoted later by v=z\V\ and ^=|fi|. 
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respectively. If T ^ v is an integer parameter, such that any subset of T points 
from V is contained in exactly X blocks, we deal with a T-4esign. A Balanced 
IncomjJkte Block Design (BIBD) is a T-design such that each block contains the 
same number of points k, and every point is contained in the same number of 
blod(8 r. 

For illustration purposes we consider only BIBB'S with T=2. Althougji 
such a BIBD still has five integer parameters v,kXb and r, only three of them 
are independent, since a straight forward proof can be used to demonstrate the 
relationships shown in Equations (Al) and (A2). 
b'k^vr (Al) 
r(jk-l) = A(v-l) (A2) 

Therefore, given three parameters, we can always find the ottier two parameters 
using Equations (Al) and (A2). The notation {vJc^BIBD is used for a BIBD 
v^th V points, block size Jfc, index A and T=2. A {v,k,iyBJBD with I = 1 is called a 
Steiner system. A Steiner system with k=3 is called a Steiner triple system. A 
BIBD is resolvable if ftere exists a partition of its block set B into parallel classes, 
each of which partitions the point set V. A resoWable Steiner triple system is 
called Kirkman system. The Roy-Chaudhuri and Wilson solution of the Kirkman 
problem leads to tive systematic consbiiction of Kirkman systems. In this 
disclosure, we vise a novel construction of ihe BIBD based on 2-dimentional 
integer lattices described below. 

First, let us consider a rectangular integer lattice 
l,={(;t,y):0^;c^ ft -l,OSySw-l}, where mis a prime number. Let 
l:L-iV be a one-to-one mapping of the lattice L to the point set V. An example of 
such mapping is a simple linear mapping as shown in Equation (A3): 
/(jcy)=moc+>'+l. (A3) 
The numbers l(x,y) are referred to as lattice point labels. The k set of points is 
referred to as a line (or a block). A line with slope s starting at the point (xa), 
0^<m-l contains the points defined in Equation (A4): 
{(x,a+Mmodm):0^ac^fc-l) (A4) 
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where 05a^m-l. 

Example 1: HG. 13 depicts the rectangular integer lattice with m=5 and fc=3. All 
lines of tixis lattice are listed bebw as defined by Equation (A4): 

8=0: {(0.0).(l,0)(2,a)). {(0,1),(1,1)(2,1)). {(O^Xd^XW)), {(0.3),(U)(23)}. {(0^X(1.4)a4)). 

5 s=l: l(0.0).(l.l)C2^)J. ((0.1).(1.2X2.3)), {(0^),(1 3X2.4)}, {(03).(1.4X2.0)). {(0,4).(1.0X2.1)), 

8=2: {(0.0).(im4)). {(0,l),a3)(2.0)), {(0,2).(1.0)(2,1)), {(03).(1.1)(2.2)}. {(0.4).(1,2X23)). 

s=3: {(0,0X(WX2,1)). {(0,l),a^XW)), {(P^)X1.0X23)}, {(03).(1,1X2.4)). {(0.4),(U)(2.0)}. 

»=4: {(PACMXWM. {(P.l).a.0X2^)), {(P^.(l.l)(2.0)). {(0,3),(1J)(2,1)}, {(0^(13X2^)). 

Another way to represent these lines is used in Table Al, where all points are 
10 given by their lalTels (A3) instead of ttieir coordinates {x,y). 

Table Al. An example of tiKe (15 A1)-BIBD constructed from a lattice 
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Proposition 2. A set B of all fc-element sets of V obtained by taking labels of 
points along the lines of a described lattice is a BIBD (Note tfiat there are m 
different slopes s, 0^:Qn -1, and m different lines for each slope). 

15 Proof: Since m is a prime, for each lattice point (x,y) there is exactly one line wifli 
slope s that goes through {x,y). In other words, for each pair of lattice points, 
there is exactly one line with slope s that contains both points- Therefore, the set 
B of lines of different slopes is a 2-design with h^m- blocks and a block size Jk, 
Proposition 2, Each point in the design occurs in exactly m blocks. 

20 Proposition 3. The number of blocks can be increased by creating the blocks 
consisting of points laying on "vertical" lines. By this way we can create 
additional m blocks. IS ml k is small, constructing additional blocks can be done 
manually, however, when {mik) ^ it for each vertical line, say x=/, we can take 
the points m x+y +1, and form a new lattice. Now we start from a new 

25 lattice and use the same design construction by taking lines with different 
slopes. 

Proposition 4. The number of blocks can be increased by creating the blocks 
consisting of points laying on "vertical" lines. By this way we can aeate 
additional m blocks. If m/ik is small, constructing additional blocks can be done 
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manually, however, when (mJk) >. k for each vertical line, say x=i, we can take 
the points m *+y+l, 0%^-l, and form a new lattice. Now we start from a new 
lattice and tise the same design construction by taking lines with different 
slopes. 

5 Proposition 5. The lattice construction can be extended to nonprime vertical 
dimensions m, but the slopes must not have common factors witii m. For 
example, if m = 6 and ik = 3, then the lines {1,7,13} and {1,10,13} with the slopes 0 
and 3, respectively, botiti contain the pair of points {1, 3}, and therefore both tiiese 
lines can not be included in the 2-design. The number of slopes that are 

10 relatively prime to m is equal to l+^(m), where 0(m) is the Euler function 
defined as the number of prime numbos less then m (slope 0 is always 
included), 

A point-block incidence matrix H=(ft,y) of a design (VJB) has v rows and b 
columns with elements /i<pl if tiae i-tii element of V occurs in tiie >-tii block of B, 

15 and h^O otherwise. Since each block of the BIBD is incident with the same 
number of points k, and every point is incident witii the same niunber of blocks 
r, then all columns of H has the same weight fc, and all rows of H has the same 
weight r. Therefore, a point-block incidence matiix H=(ft§) is in fact a parity 
check matrix of a Gallager code. This code has the lengtii n=b and the rate R=(b- 

20 rank(H;j/&. FIG. 14 shows the minimum ler^ of the lattice LDPC codes as a 
function of the required length for difierent fbced value of the minimum 
I^uiuning distance. 

It is to be understood tiiat even flioug^ numerous characteristics and 
advantages of various embodiments of the invention have been set forth in the 

25 foregoing description, together with details of the structure and function of 
various embodiments of tiie invention, this disclosure is illustiative onty, and 
changes may be made in detail, especially in matters of structure and 
arrangeixwnt of parts within the principles of the present invention to tiie full 
extent indicated by ttte broad general meaning of the terms in which tiie 

30 appended daims are expressed. For example, the particular elements may vary 
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depending on the particular appUcation for the decoding system while 
maintaining substantiaUy the same functionality without departing from the 
scope and spirit of the present invention. In addition, although an embodiment 
described herein is directed to a data storage system, it will be appreciated by 
those skilled in the art that the teachings of the present invention can be appHed 
to communication systems in general, without departing from the scope and 
spirit of the present inventioiu 
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WHAT IS CLAIMED IS : 

1. A communication system for decoding data wtdch is encoded with a 
linear low density parity check code having a parity check matrix H constructed 
from circulants, tiie communication system comprising: 

a chaimel detector (214) which provides as an output log-likelihood 

ratios, each log-likelihood ratio being indicative of a probability 
that a transmitted bit u of a code word is equal to 1; 

a low density parity check code decoder (215) coupled to the channel 
detector and receiving the log-likelihood ratios A as an input, the 
decoder configured to convert the log-likelihood ratios into real 
numbers A, to generate corrections /ito flie log-likelihood ratios 
A, and to generate corrected log-likelfliood ratios A* as a function 
of the log-likelihood ratios A and the corrections /i , the decoder 
providing as an output a binary signal 

2. The communication system of daim 1, wherein the decoder (215; 215-1) 
further comprises: 

conversion circuitry (310) which receives a stack of i log-likelihood ratios 
A(/, j) for the bit Uj of the code word and converts the stack of 
log-likelihood ratios into a stack A(i,7) of real numbers; 

product calculation circuitry (320) coupled to the conversion circuitry 
(310) which generates for each row of the parity check matrix H a 
product X (i) from tiie real numbers, where X(z) is approximately 

of the form X(0 = U^^^o^^hi). 0 S i < M, where C(0 is 

approximately of the form C(i) = {; : /i,,; = 1, 1 ^ j ^ N} ; and where 

hij isan element of i-th row and j-th column of tiie parity 

check matrix H;md 
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correction generating drcuitiy (330) coupled to the conversion droutry 
(310) and the product calculation drcuitry (320) which generates 
the corrections fi by generating each correction value of a 
stack of correction values using corresponding values from the 
stack A{iJ) of real numbers and xising the corresponding product 
X(i) from the real numbers using a relationship approximately of 

the form /z(z\;) = log^^|^i^^, where Yii,j) is approximately of 

thefonn y(/,» = X(i)/A(i,;). 

3. ^ The communication system of daim 2, wherein the decoder further 
comprises log likelihood ratio stack generating circuitry (308) coupled to the 
conversion dicuitiy (310) and to the correction generating drcuitry (330), the log 
likelihood ratio stack generating circuitry (308) calculating a new j& input stack 
A(i, j) vising a relationship approximatdy of the form 

Mi, j) = Uj) + S nil, j), where the j* set B(j) kidudes the numbers of all 

feB(y)\f 

parity checks of the low density parity check code that contain tihe j* code bit, 
and wherein set B(j) \ i is the j* set B(j) without the eletnent i , and wherein 

4. The communication system of daim 2, wherein the product calculation 
circuitry (320; 320-1) further comprises: 

an input bus (372) carrying the stack A(i, ;) of real numbers; 
a memory device (382) storing a plurality of control vectors, with each of 
the plurality of control vectors corresponding to first column of 

one of tilie drctdant sub-matrices of the parity check matrix H ; 
a first set of in switches (375) coupled to the memory device and being 
controlled by one of the pltirality of control vedors at a time, each 
of the first set of switches having inputs coupled to the ii^t bus 
and having an output; and 
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a shift register (350) including m delay elements (360) and m 

multiplication elements (370), a first input of each multiplication 
element being coupled to an output of a first corresponding delay 
element, a second input of each multiplication element being 
5 coupled to the output of a correq)onding one of the first set of 

switches (375), an output of each multiplication element being 
coupled to an input of a second corresponding delay element 
wherein the product X (i) from the real nximbers is provided by 
the delay elements* 

5* The communications system of claim 4, wherein the product calculation 
drcuitry (320; 320-1) further comprises a controller coupled to the memory 
device and controlling which of tiie plurality of control vectors is used to control 
the first set of w switches, 

6. The commtmications system of daim 2, wherein the product calculation 
circuitry (320; 320-2) further comprises: 

a plurality of parallel shift registers (350), wherein each of the plurality of 
shift registers has fixed feedback connections, and wherein an 

5 input sequence of A(i) is split onto / subsequences 

A/,(0, 0<h<t, corresponding to t drculants of H , each of the 
subsequences being entered into a different one of tiie plurality of 
shift registers 350 in parallel, each of the shift registers providing as 
an ou^ut a vector of partial products corresponding to different 

10 circulant sub-matrices of the parity check matrix H; 

a multiplication element (390) receiving as inputs the vectors of partial 
products from each of the plurality of parallel shift registers and 
sequentially providing as an ou^ut the products X{i) . 

7. The communications system of daim 2, wherein the product calcxalation 
circuitry (320; 320-3) further comprises: 
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a plurality of parallel shift registers (350), wherein each of the plurality of ■ 
shift registers has fixed feedback connections/ and wherein an 
input sequence of A(i) is split onto t subsequences 
Aft (j), 0^h<t, corresponding to t drculants of H , each of the 

subsequences being entered into a different one of the plurality of 
shift registers 350 in parallel, each of the shift registers providing as 
an output a vector of partial products corresponding to different 
drculant sub-matrices of the parity check matrix H; and 
a plurality of multiplication elements (395) each receiving as inputs the 
vectors of partial products from each of the plurality of parallel 
shift registers and providing as an output a corresponding one of 
the products X(i) . 

8. The communication system of daim 1, wherein the decoder (215; 215-2) 
further comprises: 

conversiondrcuitry (410) which receives a stadc of i log-likelihood ratios 
A(j, j)for the j* bit of the code word and converts the stack of 

log-likelihood ratios into a stack V(U j) of real numbers; 
sxmunation calculation circuitry (420) coupled to the conversion circuitry 
(410) which generates for each row of the parity check matrix H a 
summation W(i) from tiie stack V(i, J) of real numbers, wherein 
the summation W(i)is determinable using a relationship 

approximately of the form W{i) = ^V{i,j) ; and 

correction generating circuitry (430) coupled to the conversion circuitry 
(410) and the summation calculation circuitry (420) which 
generates the corrections /x by generating each correction value 
iu(i.j) of a stack of correction valiies using corresponding 
summations Wii) and real numbers according to a relationship 
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approximately of ti« form /i(t,j)°log ^^y||'^ / where Y{i,j) is 

approximately of the fbnn Y{i,j) = exp( W(t )-V"0') ) . 

9. The conuniimcati(m system of daiml, wherein the chaimeld^ 

and the low density parity check code decoder are components of a data storage 
system. 

10. A metixod of decoding data which is encoded with a linear low denaty 
parity check code having a parity check matrix H construcled from drculants, 
the method comprising; 

aerating log-likelihood ratios with a channel detector (214), each log- 
likelihood ratio being indicative of a probability that a transmitted 
bit u of a code word is equal to 1; 

converting the log-likelihood ratios A into real numbers using a low 
density parity check code decoder (215); 

generating, using the low density parity check code decoder (215), 
corrections ^ to the log-likelihood ratios A; 

g^erating, using the low density parity check code decoder (215), 

coiieded log-likelihood ratios A* as a function of the log-likelihood 
ratios A and the corrections /t;and 

providing a binary signal as an output of the tow density parity check 
code decoder (215). 

11. The method of daim 10, wherein converting the log-likelihood ratios A 
into real numbers using the low density parity check code decoder (215) further 
comprises converting a stack of i log-likelihood ratios A(i,j')forthej*bit u^of 

the code word into a stack A(i, ;) of real numbers. 



12. The method of daim 11, and furttier comprising generating, for each row 
of the parity check matrix H, a product X (0 from the real numbers, where X(0 
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is approximately of the form X(i) = Jj^^Mhj), 0^i<M, where C(0 is 
approximately of the form C(i) = =1,1^ j^N}, and where A;, ^ is an 
element of i - th row and j - th column of the parity check matrix H . 

13. Ihe metihod of daim 12, wherein generating the corrected log-likelihood 
ratios ;i' as a function of the log-likelihood ratios A and the corrections fi 
furfher comprises generating the corrections by generating each correction 
value n(i,j) of a stack of correction values using corresponding values from the 
stack A(i, ;) of real ntunbers and using fbe corresponding product X(0 from ttie 
real numbers using a relationship approximately of ihe form 

= log ['{ where Y(i,j) is approximately of the form 
Ya;) = X(f)/A(i,/). 

14. The method of daim 13, wherein converting the log-likelihood ratios A 
into real numbers further comprises calculating a new input stack A(f , j) 
using a relationship approximately of the form 

= IfiiUj), wherethej^set includes the numbers of all 

parity checks of tiie low density parity check code that contain the j* code bit 
andwheieinset BO*)\f isthejftset B{j) without the element i,and wherein 

15. A communication system for decoding data which is encoded with a 
linear low density parity check code having a parity check matrix H constructed 
from drculants, the communication system comprising: 

a channel detector which provides as an output log-likelihood ratios, each 
log-likelihood ratio being indicative of a probability that a 
transmitted bit ii of a code word is equal to 1; and 
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decoding means for receiving the log-likelihood ratios A as an input and 
for providing as an output a binary signal. 

16. The communication system of daim 15, wherein the decoding means 
further comprises: 

conviacsion circuitry which receives a stack of i log-likelihood ratios 
A(i, ;)for the bit Uj of the code word and converts the stack of 
log-likelihood ratios into a stack A(i, ;) of real numbers; 
product calculation circuitry coupled to the conversion circuitry which 
generates for each row of the parity check matrix H a product X(i) 
from the real numbers, where X{i) approximately of the form 

= IIibC(o^^^'^^' ° ^ ^ ^ M, where C(i) is approximately of the 
form C(0 = {;:/i,,; =1,1^ j<N], andv/hese hij is an element of 
i-th row and j-th colimm of the parity check matrix H;and 
correction generating circuitry coupled to the conversion circuitry and the 
product calculation circuitry which generates log-likelihood ratio 
corrections /i by generating each correction value fi{U j) of a stack 
of correction values using corresponding values from the stack 
Mhj)oi real nximbers and using the corresponding product X(i) 
from the real niunbers using a relationship substantially of the 
form M^J)=log |"y^/;-^!| , where Y(z,/) is substantially of tiie 

fonnY(i,;)=X(i)/A(t,;). 

17. The communication system of daim 16, wherein the decoding means 
further comprises log likelihood ratio stack generating circuitry coupled to the 
convereion circuitry and to the correction generating circuitry/ the log likelihood 
ratio stack generating circuitry calculating a new j* input stack ;) using a 
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relationship substantially of the form ;) = X(j) + X /^(' . j)* where the j^* 

set B(j) includes the numbers of all parity checks of the low density parity 
check code that contain the j* code bit, and wherein set B(j) \ i is the set B(j) 
without the element i, and wherein j^N, 

18. The communication system of claim 17, wherein the product calculation 
circuitry further comprises: 

an input bus carrying the stack A(i, ;) of real ntambers; 

a memory device storing a plurality of control vectors, witii each of the 
plurality of control vectors corresponding to a first coltamn of one 
of the drculant sub-matrices of the parity check matrix H ; 

a first set of switches coupled to the memory device and being controlled 
by one of the plurality of control vectors at a time, each of the first 
set of switches having inputs coupled to the input bus and having 
an output; and 

a shift register including a plurality of deky elements and a plurality of 
multiplication elements, a first input of each multiplication element 
being coupled to an output of a first corresponding delay element, 
a second input of each multiplication element being cot^led to the 
output of a corresponding one of the first set of switches, an output 
of each multiplication element being coupled to an input of a 
second corresponding delay element, wherein the product X{i) 
from the real numbers is provided by the delay elemmts. 

19. The communications system of claim 17, wherein the product calculation 
circuitry further comprises: 

a plurality of parallel shift registers, wherein each of the plurality of shift 
registers has fixed feedback connections, and wherein an input 
sequence of A(0 is split onto r subsequences . 
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Aiiii),0<h<U corresponding to ^cirailants of fl, each of ihe 
subsequences being entered into a different one of the plurality of 
shift registers in parallel, each of the shift registers providing as an 
output a vector of partial products corresponding to different 
circulant sub-matrices of the parity check matrix H; and 
a multiplication dement receiving as inputs the vectors of partial 

products from each of the pl\irality of parallel shift registers and 
sequentially providing as an output the products X (0 • 

20. The communications system of daim 17, wherein the product calculation 

circuitry furflier comprises: 

a plurality of parallel shift registers, wherein each of the plurality of shift 
registers has fixed feedback connections, and wherein an input 
sequence of A(0 is spUt onto t subsequences 
A^(0. 0 ^ /i< f, corresponding to t drculants of H , each of the 
subsequences being entered into a different one of ihe plurality of 
shift registers in paraUel, each of the shift registers providing as an 
output a vector of partial products corresponding to different 
drculant sub-matrices of the parity check matrix H; and 
a plurality of multiplication elements each receiviiig as inputs the vectors 
of partial products from each of the plurality of parallel shift 
registers and providing as an output a corresponding one of ttw 
products X(0« 
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